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Summary of Progress 
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During the period June 1, 1987 - November 30, 1987, progress was made in the following 
areas: 

1) Concatenated Codes Using Bandwidth Efficient Trellis Inner Codes 

A paper summarizing our work on the performance of bandwidth efficient trellis inner 
codes using two-dimensional MPSK signal constellations in a NASA concatenated coding 
system has been accepted for publication in the IEEE Transactions on Communications [1]. 
A preliminary version of this paper was included in our previous report (June 1987). The 
final version of the paper was recently re-submitted. Reprints will be sent when they become 
available. 

A second paper summarizing the performance of multi-dimensional trellis coded MPSK 
modulation as inner codes in a concatenated coding system has also been submitted for pub- 
lication to the IEEE Transactions on Communications [2]. Multi-dimensional trellis codes are 
ideally suited for concatenated coding systems since we can match the number of information 
bits per branch on the inner code to the symbol size of the outer code. Thus each incor- 
rectly decoded branch in the inner code results in a single symbol error for the outer code. 
This property of multi-dimensional trellis codes is exactly analogous to the property of unit- 
memory convolutional codes, first discovered by Lee [3], which made them natural choices for 
use in a concatenated system. Our results indicate that the symbol-oriented nature of multi- 
dimensional trellis codes can provide an improvement of up to ldB in the overall performance 
of a concatenated coding system when these codes replace bit-oriented two-dimensional trellis 
inner codes of similar decoding complexity. A preprint of our paper is included as Appendix 
A of this report. 

Our work on concatenated coding using bandwidth efficient trellis codes was conducted 
by Dr. Robert H. Deng, a former post-doctoral research associate supported by the Grant. 

2) Bounds on the Minimum Free Euclidean Distance of Bandwidth Efficient Trellis Codes 

A paper summarizing our work on lower bounds on the minimum free Euclidean distance 
of bandwidth efficient trellis codes has been accepted for publication in the IEEE Transactions 
on Information Theory [4]. A preliminary version of this paper was included in our previous 
report (June 1987). The final version of the paper was recently re-submitted. Reprints will 
be sent when they become available. 

A weakness of the bound presented in the above paper is that it is not tight at short 
constraint lengths, the most useful range for practical codes. We are currently working on 
a new bound which is much tighter at short constraint lengths. This bound can be used to 
predict the achievable free distance for practical constraint lengths and signal constellations. 
Code searches can then be conducted using the most promising signal constellations. A 
summary of our work on this new bound is included as Appendix B of this report [5]. A 
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full length paper is being prepared for submission to the IEEE Transactions on Information 
Theory. 

Our work on minimum distance bounds for bandwidth efficient trellis codes is being con- 
ducted by Mr. Marc Rouanne, a Ph.D. student supported by the Grant. 

3) Performance Analysis of Bandwidth Efficient Trellis Codes on Channels with Phase Jitter 

Bandwidth efficient trellis coded phase modulation (TCPM) is a powerful means of achiev- 
ing high data rates on bandlimited satellite channels. The performance of these coding/ modulation 
schemes is usually analyzed assuming an ideal AWGN channel model. Many real channels, 
however, also suffer from phase jitter due to synchronization inaccuracies in the phase recovery 
loop. This phase jitter results in a time-varying phase error by which the signal constellation 
is rotated. We have begun an examination of the effect of this phase error on the performance 
of TCPM schemes. A summary of our initial results is included as Appendix C of this report 
[ 6 ]- 

We have found that codes which are optimum for the ideal AWGN channel may perform 
quite poorly on a chennel subject to phase jitter. We are able to measure the performance 
degradation of these codes in decibels as a function of the ratio of the phase noise power of the 
receiver to the thermal noise power of the channel. For example, Ungerboeck’s [7] 64-state, 
rate 2/3, 8-PSK scheme, which achieves a 4.77 dB coding gain over uncoded QPSK on an ideal 
channel, suffers a 1.25 dB degradation in performance when the phase noise power is 20% of 
the thermal noise power. We are conducting a computer search for codes which are optimum 
on channels with phase jitter. The performance of these codes will then be compared to codes 
which were designed for the ideal channel. The results of this code search will be included in 
our next report. 

Our work on bandwidth efficient trellis codes on phase jitter channels is being conducted 
by Mr. Christian Schlegel, a Ph.D. student supported by the Grant. 

4) Construction of Bandwidth Efficient Trellis Codes 

We have continued our work on the construction of multi-dimensional bandwidth efficient 
trellis codes with MPSK modulation. A paper submitted to the IEEE Transactions on Infor- 
mation Theory was included in our February 1987 semi-annual progress report. This paper has 
now been accepted for publication and is currently being revised for re-submission [8]. Upon 
initial submission, the paper attracted quite a bit of attention from the Information Theory 
community. Two other researchers (G. Ungerboeck from the IBM communications research 
laboratory in Zurich, Switzerland and S. S. Pietrobon from the South Australian Institute 
of Technology, Adelaide, South Australia) contacted us about combining our results with 
similar results which they had obtained. The revised paper now contains contributions from 
three research groups and will make an outstanding contribution to the field of coded modu- 
lation. In addition to the original constructions of multi-dimensional trellis codes for 8-PSK 
modulation, new multi-dimensional codes have been added for 16-PSK modulation and multi- 
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dimensional 8- and 16-PSK codes have been constructed which are invariant (transparent) to 
rotations of the signal set when used with differential encoding. This latter property allows 
continued reliable communication when the receiver tracking loop locks onto the wrong signal 
phase. Among the advantages of multi-dimensional codes over conventional two-dimensional 
constructions are (i) the ability to achieve higher data rates, (ii) better coding gains, (iii) the 
ability to achieve transparency to discrete phase rotations of the signal set, and (iv) better 
performance as inner codes in a concatenated system. Reprints of the final version of this 
paper will be submitted when they become available. 

Our work on the construction of multi-dimensional trellis codes was initiated by Mr. Alain 
LaFanechere, a former student supported by the Grant, and by Dr. Robert H. Deng and is 
now being continued, with emphasis on the construction of codes which are invariant to phase 
rotations of the signal set, by Mr. Steven S. Pietrobon, a new Ph.D. student supported by 
the Grant. 

In addition to the construction of multi-dimensional trellis codes, we have also begun work 
on some hueristic construction algorithms for bandwidth efficient trellis codes with larger 
constraint lengths. These constructions are sub-optimum, but are designed to produce good 
long bandwidth efficient codes which are suitable for use with sequential decoding. The large 
constraint lengths make an exhaustive search for optimum codes impractical, but we are 
encouraged that good long codes can be constructed using our algorithms. A summary of our 
initial results is included as Appendix D of this report [9]. The work is being conducted by 
Mr. Marc Rouanne. 

5) Parity Retransmission Hybrid ARQ Using Convolutional Codes 

A paper summarizing our work using convolutional codes with parity retransmission hybrid 
ARQ has been accepted for publication in the IEEE Transactions on Communications [10]. 
The final version of the paper is currently in preparation. A preprint is included as Appendix 
E of this report. This paper complements work done by Lin and Yu with block codes [11]. 
The paper includes an unique analysis of the performance of these codes on bursty channels. 
A major result is that throughput efficiency is shown to improve as the channel becomes 
more bursty in nature. This is consistent with the design philosophy of type-II hybrid ARQ 
schemes, which are intended for use on bursty channels. The paper also demonstrates that 
the convolutional code scheme achieves a very high reliability. This work was initiated by Dr. 
Laurent R. Lugand, a former Ph.D. student supported by the Grant, and was completed by 
Dr. Robert H. Deng. 

The current paper discusses only the use of rate 1/2 convolutional coding schemes. Higher 
throughputs can be achieved by using rate 2/3 and 3/4 schemes, although the retransmission 
protocol becomes more complex. We will discuss the performance of these higher rate schemes 
in a future report. 
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Abstract 

In a previous paper [1], a concatenated coding system employing 2- 
dimensional (2-D) trellis coded MPSK inner codes and Reed-Solomon 
outer codes for application in high speed satellite communication sys- 
tems was proposed. This paper extends the results of [1] to systems 
using symbol-oriented multi-dimensional trellis coded MPSK inner 
codes. 

The concatenated coding systems will be divided into two classes 
according to their achievable effective information rates. The first 
class uses multi-dimensional trellis coded 8PSK inner codes and achie- 
ves effective information rates around 1 bit/Dimension (spectral effi- 
ciency 2 bps/Hz). The second class employs multi-dimensional trel- 
lis coded 16PSK inner codes and provides effective information rates 
around 1.5 bits /Dimension (spectral efficiency 3 bps/Hz). Both classes 
provide significant coding gains over an uncoded reference system with 
the same effective information rate as the coded system. 

'This work was supported by NASA Grant NAG5-557. 
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I. Introduction 


In [1], a concatenated coding system with 2-dimensional (2-D) trellis coded 
MPSK (TCMPSK) inner codes and Reed-Solomon (RS) outer codes for 
application in high speed satellite communication systems was proposed. It 
was argued there that TCMPSK inner codes along with soft decision Viterbi 
decoding plays two important roles in a concatenated coding system: 

1. Compensating for the bandwidth expansion introduced by the outer 
code; 

2. Compressing the random errors on the inner channel into symbol 
errors which can be corrected by a symbol-error-correcting outer code, 
such as an RS code. 

In trellis (convolutional) inner code/RS outer code concatenated coding 
systems, such as those in [1] and [2] which employ a soft decision Viterbi 
decoder for the inner code, it is unlikely that the beginning of a decoding 
error burst is aligned with the boundary between two RS symbols. This 
fact was first observed by Lee [3] for binary convolutional inner code/RS 
outer code concatenated coding systems and led to the discovery of symbol- 
oriented unit memory inner convolutional codes. This observation leads us 
to consider using symbol-oriented multi-dimensional (multi-D) TCMPSK 
inner codes rather than bit-oriented 2-D TCMPSK inner codes. A typical 
concatenated coding system is shown in Figure 1. The outer code is an 
(N, K) RS code with N = 2 b — 1 and symbols over GF{ 2 b ). The inner code 
is rate Ri = bfn, 2 " — state, multi-D TCMPSK, where b, the number of 
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information bits entering the inner encoder per encoding interval, is chosen 
to equal the RS code symbol size. 

Encoding is performed in two stages. An information sequence of Kb 
bits is divided into K symbols of b bits each, and each 5-bit symbol is 
regarded as an element of GF( 2 6 ). These K symbols are used as inputs to 
the RS encoder. The output of this encoder is an iV-symbol codeword which 
is symbol-interleaved and then serially encoded by the trellis encoder with 
b input bits per encoding interval. Decoding is accomplished in the reverse 
order. The inner channel is assumed to be an additive white Gaussian noise 
(AWGN) channel with single sided power spectrum Nq. The inner code is 
decoded by a Viterbi decoder without demodulator output quantization. 
The outer decoder is an errors-only RS decoder. 

The concatenated coding systems will be divided into two classes ac- 
cording to their achievable effective information rate. Class 1 systems 
use multi-D TC8PSK inner codes and achieve effective information rates 
around 1 bit/Dimension (spectral efficiency 2 bps/Hz). Class 2 systems 
employ multi-D TC16PSK inner codes and achieve effective information 
rates around 1.5 bits/Dimension (spectral efficiency 3 bps/Hz). Their per- 
formance is studied in sections II and III, respectively. 

II. Systems Employing Multi-D TC8PSK Inner Codes 

In this section we study the performance of concatenated coding systems 
with the multi-D TC8PSK schemes constructed in [4] as inner codes. For 
any positive integer L > 2, a rate = b/2L,2L — D TC8PSK scheme has 
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an effective information rate in information bits per dimension (bits/D) 

R l $ f = b/2L > 1 bit/D, 2 L < b < 3 L - 1. (1) 

Then the overall effective information rate of the concatenated coding sys- 
tem 

R 'JI = *2/1 ■ f < *'// (2) 

is around 1 bit/D. 

Let P a denote the symbol error probability into the outer decoder. As- 
suming bounded distance decoding of the outer code, the decoded bit error 
rate (BER) at the output of the outer decoder is closely approximated by 

(3) 

where d is the minimum Hamming distance of the RS code and t = |_(d — 1)/2J 
is its symbol-error-correcting capability [5]. 

The performance of the concatenated coding system will be measured in 
terms of the coding gain at a given target BER P b over an uncoded reference 
system with the same effective information rate R e j / as the coded system, 
i.e., 2 2R *Ji PSK modulation. 1 (This comparison was suggested by Forney 
[6].) The BER for the reference system is then given by 



1 Since 2 2R ‘ lf may not be an integer, this uncoded reference system may be only hy- 
pothetical. It is used for comparison purposes since it has exactly the same effective 
information rate as the coded system. 
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where E b /N 0 is the channel “information bit energy- to- noise power density 
ratio” , and 

Ag = 2 — 2 cos (27r/2 2i?e ") (5) 

is the normalized minimum squared Euclidean distance of the 2 2R *f f PSK 
signal set. 

The coding gain of a concatenated coding system over the uncoded 
reference system, denoted by 7, is found as follows. We first find the 
{E b / N 0 ) uncoded required to achieve a target BER from (4). Then we find 
the (E b /N 0 ) coc i e< i required to achieve the same BER using (3), where the 
symbol error probability P 3 is obtained by computer simulation of the in- 
ner decoder. The coding gain is then given by 



Fig. 2(a) shows the coding gain at P b = 10 -6 and P b = 10~ 9 with respect 
to R e ff for a concatenated coding system with Ri = 5/6, 4-D TC8PSK 
inner codes and N = 2 5 — 1 = 31 RS outer codes. Results are given for 
inner codes with 4 and 8 states. The gain (loss) of the reference system 
over QPSK is also plotted in the figure. The coding gain over QPSK of a 


concatenated coding system can be found by adding 7 to the gain (loss) 
over QPSK of the reference system with the same R e ff- To achieve higher 
effective information rates and larger coding gains, more powerful RS outer 
codes can be employed. Fig. 2(b) shows the coding gain with respect to 
R e ff for a concatenated coding system with the same inner codes as in Fig. 
2(a) but with N = 2 10 — 1 = 1023 RS outer codes. The RS symbol size is 
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twice the number of input bits to the inner encoder per encoding interval 
in this case. 

Fig. 3(a) depicts the coding gain for a concatenated coding system with 
Ri = 7/9, 6-D TCSPSK inner codes and N = 2 7 — 1 = 127 RS outer codes. 
Higher effective information rates can be achieved by a concatenated coding 
system employing R\ = S/9, 6-D TCSPSK inner codes and N = 2 8 — 1 = 
255 RS outer codes. Its coding gain is shown in Fig. 3(b). Both systems 
achieve roughly the same coding gains with a 4-state inner code. 

Fig. 4 shows the coding gain for a concatenated coding system with 
Ri = 8/12, 8-D TC8PSK inner codes and N = 2 8 — 1 = 255 RS outer 
codes. The three inner codes have the same minimum squared Euclidean 
distance dj, but decreasing path multiplicity as the number of trellis states 
increases. Note that only about 0.1 dB more gain is obtained with every 
doubling of the number of trellis states. 
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III. Systems Employing Multi-D TC16PSK Inner Codes 


The overall effective information rate of a concatenated coding system with 
multi-D TCSPSK inner codes is always less than 1.5 bits/D. To achieve 
higher rates, multi-D TC16PSK must be used as inner codes. For any pos- 
itive integer L > 2, the R\ = 6/4L, 2 L — D TC16PSK schemes constructed 
in [7] have an effective information rate 

R { e )) = b/2L > 1.5 bits/D, 3L < b < 4L - 1. (7) ' 


From (2), the overall effective information rate of the concatenated coding 
system is around 1.5 bits/D. 

Due to the symbol-oriented nature of the inner codes, the concatenated 
coding system performance can be estimated using formula calculations 
as well as by simulation. Let S{dj) denote the total number of symbol 
errors associated with paths that are distance dj from the correct path, 
normalized by the number of decoding intervals on each path. Then S(d 2 ) 
is upper bounded by the number of paths that are distance dj from the 
correct path, P(d 2 ), a parameter known for most TCM codes. To see this, 
let P,(dj) be the number of paths of length i decoding intervals that are 
distance dj from the correct path, and let n, be the maximum number of 
symbol errors associated with these paths. Then it follows that 





Y,Pi(d)) = P(i% (8) 


since the number of symbol errors along any path of length i is bounded 
by m and n, is bounded by i. The symbol error probability P 3 to the outer 
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decoder, for large values of Eb/No, can be approximated by 


P s « S{d))Q 


dfReffEb 

N N 0 


( 


< P(d))Q 


\ 


d 2 j:R e ffEb 

N JVo 


( 9 ) 


where R e /f is the overall effective information rate of the concatenated 
coding system. The final decoded BER Pj, can be found by using (9) in (3). 

Since a close approximation to P, using (9) requires a high Eb/N 0 ratio, 
or equivalently P s « 1, in the following we only consider RS outer codes 
with d = 3 and 5, since these are sufficient to achieve decoded BER’s in 
the range 10 -6 ~ 10 -9 . Fig. 5 compares the performance obtained by 
the formula calculations to that obtained through computer simulations 
for a concatenated coding system with an Pi = 5/6, 4-state, 4-D TC8PSK 
inner code and an N = 31 RS outer code. It is seen that the formula 
calculations and the simulations are very close at P& < 2 x 10 -5 for d = 3 
and P* < 2 x 10 -7 for d = 5. 2 

The coding gains obtained by formula calculations vs. the inner code 
constraint length v are shown in Figs. 6(a) and 6(b) for systems with 4-D 
TC16PSK inner codes and in Figs. 7(a) and 7(b) for systems with 6-D 
TC16PSK inner codes. The coding gains of the inner codes alone are also 
shown in the figures for comparison. 

The advantage of concatenated coding over the inner code alone is ob- 
vious. With a d = 3 RS outer code, the concatenated coding system offers 
0.75 ~ 1.25 dB more coding gain at Pj, = 10 -6 and 1.25 ~ 1.75 dB more 

2 The formula calculations are expected to be more accurate for larger RS code lengths 
N , say N = 127, for then the RS code rate is higher and lower values of P s are needed to 
achieve _Pj = 10 -6 (P, as 10 -4 ) and Pj = 10 -9 (P 3 ai 10 -5 ). 
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coding gain at P b = 10 -9 , respectively, than the inner code alone (3 dB 
more coding gain asymptotically). With a d = 5 RS outer code, the con- 
catenated coding system offers 1.25 ~ 2 dB more coding gain at P b = 10 -6 
and 2.25 ~ 2.5 dB more coding gain at P b = 10 -9 , respectively, than the 
inner code alone (4.77 dB more coding gain asymptotically). 
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IV. Conclusions 


We have studied the performance of concatenated coding systems with 
symbol-oriented multi-D TCMPSK inner codes. The advantages of using 
symbol-oriented multi-D TCMPSK inner codes are best seen by comparing 
the coding performance with that of concatenated coding systems employ- 
ing bit-oriented inner codes. Fig. 8 shows the performance of two concate- 
nated coding systems. System 1 uses an Ungerboeck Ri = 2/3 (R^/f = 
1 bit/D), 16-state, 2-D TC8PSK [8] inner code and a (255,223) RS outer 
code. System 2 employs an Ri = 8/12 {R^/j = 1 bit/D), 4-state, 8- 
D TC8PSK [4] inner code and the same outer code. Both systems have 
an effective information rate R e jj = 0.875 bits/D. Ungerboeck’s 16-state 
code has a 4.13 dB asymptotic coding gain, while the 4-state, 8-D code 
has only a 3 dB asymptotic coding gain and a much larger path multiplic- 
ity. However, system 2 is inferior to system 1 by only 0.05 ~ 0.11 dB at 
Pb — 10~ 6 ~ 10 -9 . Thus, the symbol-oriented nature of the 4-state, 8-D 
TC8PSK inner code provides an improvement of more than 1 dB in over- 
all performance. Moreover, the 4-state code is simpler to decode than the 
16-state code. 

To further justify this observation, Fig. 9 shows another system per- 
formance comparison. In Fig. 9, system 1 uses an R\ = 8/9 (R^/j = 
1.33 bits/D), 4-state, 2-D periodic time-varying trellis coded (PTVTC) 
8PSK [9] inner code and a (255, 201) RS outer code. System 2 uses an 
Ri = 8/9, 4-state, 6-D TCSPSK [4] inner code and the same outer code. 
Both systems have R e /j = 1.05 bits/D. Both inner codes have a 2.9 dB 
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asymptotic coding gain and roughly the same path multiplicity. However, 
system 2 offers 0.6 dB more coding gain than system 1, which is entirely 
due to the symbol-oriented nature of the R\ = 8/9, 4-state, 6-D TC8PSK 
inner code. 

From the performance studies presented above, we can draw a number 
of conclusions. 

1. The symbol-oriented nature of multi-D TCMPSK inner codes can 
provide an improvement of up to 1 dB in the overall performance of 
a concatenated coding system when these codes replace bit-oriented 
2-D TCMPSK inner codes. 

2. Most of the coding gain can be obtained by using 4 ~ 16 — state 
inner 'codes. Therefore, choosing inner codes with a small number 
of trellis states increases the data transmission rate (by reducing the 
number of decoder computations) with only a slight sacrifice in system 
performance. 

3. The path multiplicity of the inner code exerts less influence on the per- 
formance of a concatenated coding system than on the performance 
of the inner code by itself (see Fig. 7(a) at v = 4 and Fig. 7(b) at 
v = 2). This can be explained as follows. Using Forney’s [10] rule 
of thumb, the path multiplicity degrades the performance of a trellis 
code at P;, = 10 -5 by 0.25 dB for every increase in the multiplicity 
by a factor of 2. However, since the errors in the output of a Viterbi 
decoder are highly bursty, the information bit errors along a path are 


11 



concentrated into only a few symbol errors. After deinterleaving, the 
symbol errors will be corrected with high probability by the RS outer 
code. This fact provides a basis for statement 2 in section I. 
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Fig* 6(b) Coding gain vs* v for a concatenated 
coding system with an = 6/8, 4-D TC16PSK inner 

code and an N = 63 RS outer code* 
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Fig. 7(a) Coding gain vs. v for a concatenated coding 
system with an = 11/12, 6-D TC16PSK inner code and 

an N = 2047 RS outer code. 
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Fig. 7(b) Coding gain vs. v for a concatenated coding system 
with an R 1 = 10/12, 6-D TC16PSK inner code and an N = 1023 RS 

outer code. 
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Fig. 8 Performance comparison for concatenated codin 
systems with 

(1) An = 2/3, 16-state, 2-D TC8PSK inner 

code and an (255,223) RS outer code; 

(2) An R^ = 8/12, 4-state, 8-D TC8PSK inner 

code and the same outer code. 
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Fig. 9 Performance comparison for concatenated coding 
systems with 

(1) An = 8/9, 4-state, 2-D PTVTC/8PSK inner 

code and an (255,201) RS outer code; 

(2) An = 8/9, 4-state, 6-D TC8PSK inner code 

and the same outer code. 
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ABSTRACT 

An expurgated lower bound on the minimum free Euclidean distance dp. ee of Trellis 
Coded Modulation (TCM), which guarantees the existence of good TCM schemes of any com- 
plexity, is presented. Random coding lower bounds (Gilbert bounds) on the free distance of 
binary codes in particular, and of trellis codes in general, are not very tight for small constraint 
lengths, whereas they are exponentially tight for large constraint lengths. We tighten the best 
lower bound known on the free Euclidean distance of TCM schemes by expurgating the set of 
codes for which the bound holds to obtain an "expurgated bound on d^. e " . The expurgated 
bound is tighter than any other lower bound for small constraint lengths and is equivalent to 
the best asymptotic bounds for large constraint lengths. 

INTRODUCTION 

An efficient binary trellis encoder assigns binary codewords to branches to achieve the 
largest possible minimum Hamming distance d h between output sequences generated by 
different information sequences. This guarantees minimum error probability when using max- 
imum likelihood decoding. Similarly, an efficient non-binary Trellis Coded Modulation (TCM) 
scheme assigns channel signals to branches to achieve maximum dp. et , and hence mini mum 
error probability when using maximum likelihood decoding. Many of the best known trellis 
codes show a rapid increase in the metric (Hamming or Euclidean distance) between diverging 
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and remerging branches in the trellis. In other words, the first and last branches of error events 
contribute most of the overall distance between a correct path and an error path, at least for 
short constraint lengths. 

A (Jk,v) trellis code corresponds to k shift registers of lengths V; £ v (1 <, i £ k). k is the 
input width of the trellis code and v its memory order. Here, we assume that all the shift regis- 
ters have the same length v so that v 0 * bf is the constraint length of the trellis code. Two 
branches in a trellis are adjacent if they leave or reach the same state (Figure 1). The minimum 
adjacent distance of a trellis code is the minimum distance between adjacent branches in 
the trellis. Ungerboeck searched for pseudo-optimum TCM schemes with a large increase in 
the metric at the ends of error events for 2-dimensional signal constellations [1]. Most of his 
codes still stand as the best known codes. Wei generalized Ungerboeck’ s approach, and con- 
structed TCM schemes with large or even maximum d ^ for multidimensional signal constella- 
tions [2]. In general, most of the TCM schemes presented by Forney achieve a large minimum 
adjacent distance [3]. All these results indicate that codes with large adjacent distances tend to 
be good codes on the average. Therefore, we derive an expurgated lower bound for a set of 
codes with large minimum adjacent distance. 

The expurgated lower bound on the free Euclidean distance of trellis codes consists of 
two parts: a random coding bound on the distance between branches in the middle of error 
events and a lower bound on die distance between branches at the ends of error events. For 
small constraint lengths, the major contribution to an error path metric comes from the second 
part of the bound, whereas for large constraint lengths the first part of the bound is more 
important. 


THE SET OF CODES 

The derivation of the expurgated lower bound on the free Euclidean distance of trellis 
codes is an extension of the derivation of the random coding bound derived for the set of all 
time-varying Euclidean Trellis Codes [4] which owes much to Chemoff, Gallager, Viterbi and 
Forney [5] -[8]. The first difference between the two derivations comes from the definition of 
the set of codes. For any 8 > 0, Cg denotes the set of (£,v) trellis codes c which have minimum 
adjacent distance d^j > 8. For any 8, the expurgated bound lower bounds the average free 
Euclidean distance of codes in Cg. 



The following Lemmas answer the questions: Is it possible, for the same trellis code, to 
maximize the distance between diverging branches and the distance between remerging 
branches? How do these maximizations affect the distances between branches that are not adja- 
cent? The Lemmas are based on the notion of 2-state subtrellis. For example. Figure 2b shows 
the two 2-state subtrellises of the 4-state trellis in Figure 2a. 

Lemma 1: Given a signal constellation S which contains M equiprobable signals, Y, and Y( 
represent two non-adjacent branches which correspond to the same time interval t, and y, is the 
signal labeling Y ( , then the probability p(y!\y t ) over all codes in C$ that y{ is the label for Y( is 

(i) ply! |y,) £ M p(y!) if Y, and Yf belong to the same 2-state subtrellis, 

(ii) p(y!\y t ) = ply!) if F, and Y,' do not belong to the same 2-state subtrellis. 

Lemma 2 upper bounds the probability of a particular labeling of an error path given 
the labeling of the correct path over all codes in C 5 . 


Lemma 2: Given a labeled path y_ in a (k, v) trellis code in C$, the probability of a labeling y[ 
for an error path of length x is bounded by 

piy\y) = II/>0'r'ly<) ^ piyibi) ply-! W m 23 ™ 

t= t 1=2 

where B( T,v) = \xN - 2] + and ["•*!+ is the smallest non-negative integer larger than or equal to 
x. 

Proving Lemma 2 consists in counting the number of branches in an error event which satisfy 
(i) or (ii) and are not at the ends of the error event. 

DERIVATION OF THE BOUND 
The first step consists in stating what must be proved 
Assertion: For any 5 > 0 and any expurgated set C 5 of codes c and for any a > 0 

^ S Pl c ) Z Z < 1 => 3 c Q e C 5 s.t. dp. ee (cQ) > d, 

C e Cl 1 e c 2'e t t (c) 


where e£c) is the set of error paths in c diverging from y_ at time 1. 


The next step, what Forney calls configuration counting, consists of regrouping the 
labeled paths y (or /) that correspond to the same unlabeled paths Y (or If). This is very simi- 
lar to configuration counting over the set C of all time varying trellis codes, since it essentially 
depends on the topology of the trellis. This step depends heavily on Lemma 2. The last step 
puts the bound in its final form: 


Theorem: Given a signal constellation S and a distance S, there exists a (Jfc, v) trellis code 
with maximum minimum adjacent distance £ 8 and minimum free Euclidean distance dp. tt 
such that: 


4 - > 28 2 + 


{ max 
£(a) >ila2 + 1/vlnM 
OS o 


( V - 2 ) mssl - 

a a 


where 


m 4 - in z p<?) I p</) 

yeS y’eS 

d e (y,y) is the Euclidean distance between signals y and /, 


e'[£«x)] ^ in— 1 




! _ g -vT, + lnAf’ 

ri = [£(a) — fcln2], and 
a is a parameter which optimizes the bound. 


APPLICATION OF THE BOUND 

The expurgated bound is mostly useful for small constraint lengths, since it is 
equivalent to random coding bounds for large constraint lengths. For example, if the Euclidean 
distance can be made proportional to the Hamming distance as in BPSK modulation, then the 
bound applies to binary trellis codes like convolutional codes. Table 1 shows a comparison of 
the expurgated bound with the best random coding bound [9], the best known codes [10], and 
Heller’s very tight upper bound [11], for rate .1/4 convolutional codes. 


Since upper bounds are not as fight as the Heller bound for TCM schemes used with 
M-ary modulation, the bound is most useful for trellis codes used with M-ary modulation like 
M-PAM or M-PSK signal constellations. Figure 3 shows the expurgated bound for 8-PSK 
modulation compared with the best known rate 2/3 codes [1], upper bounds [12]-[13], and the 
random coding bound [4]. 

The expurgated bound, like any other random coding bound on convolutional or trellis 
codes, applies only to rate ldn codes generated by k shift registers of equal length. However, 
trellises that represent shift registers of various lengths can be decomposed into nested trellises 
[14], to which the bound applies. Figure 4 shows a general representation of nested trellises. 
Figure 5 shows a 2 level nested trellis (Figure 5c) where the branches of the trellis in Figure 
5b have been replaced with the trellis in Figure 5b (the input width k determines the number of 
levels of a nested trellis). For example, Ungerboeck’s trellises are nested trellises where paral- 
lel branches represent 1 -state trellises (Figure 5d). When the distance between parallel branches 
limits the achievable free distance of a code, they can be replaced with trellises to introduce 
redundancy between sequences of signals from the same subsets (Figure 4) [15]. The free dis- 
tance of a nested trellis code satisfies 

dfrte ~ Hljn Wi))» 

where <^. M (v,) is the free distance of any subtrellis of level i, where a subtrellis of level i 
represents the last k - i + 1 shift registers [14]. The expurgated bound on d^ tt can be used to 
lower bound each <^ M (v,-) by replacing the distances between signals with distances between 
subsets of signals that correspond to level i (Figure 4). This gives a lower bound on the 
minimum free Euclidean distance which applies to any trellis code. 

A more general and tighter version of the bound can be derived, but involves a more 
detailed proof [15]. In general, this bound shows that random coding bounds can be improved 
significantly by restricting the set of codes. It also shows that codes with a large increase in the 
metric at the ends of error events perform well on the average. Finally, it can be used to com- 
pare TCM schemes with small constraint lengths without having to search for the correspond- 
ing codes. 



REFERENCES 


[1] G. Ungerboeck, "Channel Coding with Multilevel Phase Signals”, IEEE Trans. Inform. Theory, 
vol. IT-28, pp. 55-67, Jan. 1982. 

[2] LF. Wei, "Trellis-Coded Modulation with Multi-dimensional Constellations", IEEE Trans. 
Inform. Theory, Vol. IT-33, pp. 483-501, July 1987. 

[3] G.D. Forney, Jr., "Coset Codes L- Geometry and Classification", IEEE Trans. Inform. Theory, to 
appear. 

[4] M.F. Rouanne and DJ. Costello, Jr., "A Lower Bound on the Minimum Euclidean Distance of 
Trellis Coded Modulation Schemes", IEEE Trans. Inform. Theory, to appear. 

[5] H. Chemoff, "A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on a Sum 
of Observations," Ann. Math. Stat. , vol. 23, pp. 493-507, 1952. 

[6] R. G. Gallager, "A simple Derivation of the Coding Theorem and Some Applications," TF.FF. 
Trans. Inform. Theory , vol. IT- 11, pp. 3-18, Jan. 1965. 

[7] A. J. Viterbi, "Eiror Bounds for Convolutional Codes and an Asymptotically Optimum Decod- 
ing Algorithm," IEEE Trans. Inform. Theory , vol. IT-13, pp. 260-269, Apr. 1967. 

[8] G. D. Forney, Jr. "Convolutional Codes It Maximum Likelihood Decoding", Infer- mation and 
Control , vol. 25, pp. 222-266, July 1974. 

[9] D. J. Costello, Jr. "Free Distance Bounds for Convolutional Codes", IEEE Trans. Inform. 
Theory, vol. IT-20, pp. 356-365, May 1974. 

[10] K. J. Larsen, "Short convolutional codes with maximal free distance for rates 1/2, 1/3, and 1/4," 
IEEE Trans. Inform. Theory, vol. IT-19, pp. 371-372, May 1973. 

[11] J.A. Heller, "Short constraint length convolutional codes," Jet Propul. Lab., Calif. Inst. Tech., 
Pasadena, CA. Space Programs Summary 37-54, vol. 3, pp. 171-174, Dec 1968. 

[12] G.J. Pottie and DP. Taylor, "Sphere-Packing Upper Bounds on the Free Distance of Trellis 
Codes", IEEE Trans. Inform. Theory, to appear. 

[13] M. Bumashev and E. Biglieri, "Bounds on the Minimum Distance of Trellis Codes", submitted 
to IEEE Trans. Inform. Theory, 1986. 

[14] M.F. Rouanne and DJ. Costello, Jr., "Nested Trellis Codes", in preparation. 

[15] M.F. Rouanne and D.J. Costello, Jr., "An Expurgated Lower Bound on the Free Distance of 
Trellis Coded Modulation Schemes", in preparation. 


(a) 1 input bit 


(b) 2 inpct bits 


Figure 1: Adjacent distances for 1 or 2 input bits. 



Figure 2: 2-state subtreilises in a 4-state trellis. 





Table 1: Bounds on the minimum free Hamming distance of trellis coded BPSK 
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Figure 4: A generalized Trellis Coded Modulation scheme (nested trellis). 
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EXAMPLE OF UNGERBOECK’S TRELLIS CODE. 
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Figure S: Examples of nested trellises. 
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Abstract 

Bandwidth efficient Trellis Code Modulation (TCM) is usually designed to maximize the 
free Euclidean distance dj ree . While this assures good performance on AWGN channels 
it is shown that such codes suffer severe degradation on channels with phase errors. The 
problem is compounded due to the fact that the performance gain of TCM coding schemes 
is achieved at the expense of expanding the signal sets used, which results in poorer phase 
synchronization. 

A generalized distance measure is introduced which becomes the new design criterion 
for coding on channels with phase jitter. This generalized distance is found by applying 
the Chernoff bounding technique to these channels. The performance of existing codes is 
compared to some new codes, designed with the new criterion in mind. Hard quantizing 
the output of the jitter channel in conjunction with RS-codes in order to avoid dealing with 
unreliable distance metrics is also examined. 
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BANDWIDTH EFFICIENT CODING ON CHANNELS WITH PHASE 

JITTER 1 
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Summary 

In recent years bandwidth efficient Trellis Coded Modulation (TCM) with multilevel/phase 
signaling introduced by Ungerboeck [1] has become increasingly popular and much analysis 
has been devoted to the performance of these coding schemes on AWGN channels. In this 
paper we examine AWGN channels that further suffer from phase jitter due to synchroniza- 
tion inaccuracies of the phase recovery loop. This phase jitter materializes as a time varying 
phase error 9(t) by which the signal constellation is rotated. We assume throughout the 
paper that DSB AM-modulation is used with coherent reception and that the phase error 
therefore affects two dimensions at a time (i.e., the quadrature and in-phase components). 
We further assume at each signaling interval that the receiver has no information about 
the phase error, because if it had such information, the received 2-dimensional signals could 
simply be rotated back by the erroneous phase angle into the correct position. 

An upper bound is presented on the two code word error probability for coded commu- 
nication systems on an arbitrary memoryless channel. This bound, which is based on the 
Chernoff bounding technique, has the form 


N 

p 2 [x -* x] < n (l) 

j=i 

where x = [xi, • • • 3Ln] an d x = [&!,••• Xat] are the two code words of length N and C (£.j , ) 
is the Chernoff factor of the two 2-dimensional signals Xj and Using the bound (1) on 
the two code word error probability, the cutoff rate Rq for a random ensemble of codes and 
the transfer function bound for specific codes can be evaluated immediately. 

We then apply (1) to the “phase jitter” channel. The carrier phase is usually tracked with 
a first-order phase locked loop as discussed in [2] and [3]. The phase error 6(t) in the steady 
state is then known to obey a Tikhonov density function which can be closely approximated 
by the Gaussian density function for phase deviations a g as large as 10 degrees. Other 
contributions to the phase error can also be modeled as Gaussian processes, as discussed in 
[4]. We therefore use the Gaussian denisty function for 9 in the analysis, i.e., 
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We then show that for the phase jitter channel the Chemoff factor becomes 

2 f | |2 2pl«,-| 2 lljl 2 « i 4 » 2 ( 9 >) 1 


(3) 


where p = <Tq/N 0 is the ratio of phase noise power to channel noise power. The above 
equation shows that in the case of phase jitter a new distance measure dominates the 
performance of a code. This distance measure 


d(x,x) = 



2p|& 7 | 2 li J l 2 sin 2 (fl j ) \ 
1 - Pikjl 2 - l^llijl cos(^))/ 


(4) 


is still additive and reduces to the Euclidean distance for negligible phase noise, i.e., for 
p — ► 0. 

We contrast the performance of trellis codes with maximum Euclidean distance to TCM 
codes specifically designed for phase jitter channels. For example, a 64-state Trellis Code 
using 8-PSK signaling with a gain of 4.77 dB on an AWGN channel suffers a degradation 
of 0.38 dB for p = 0.1, 1.25dB for p = 0.2, and 5.07dB on a severly impaired channel with 
p = 0.4. Another bandwidth efficient coding scheme employs Reed Solomon block codes 
with multilevel/phase signaling in conjunction with hard decision decoding. This method 
is inferior to TCM coding on AWGN channels and for small SNR values, but becomes more 
attractive on channels with phase jitter because the hard decision decoding is less sensitive 
to phase errors. 
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ABSTRACT: We present a construction technique for good trellis codes with large 
constraint length. The technique can be used for any practical constraint length, any 
signal constellation, and any code rate. The construction does not require an exhaustive 
search, so that the complexity of the construction does not increase significantly with 
the constraint length. However, it requires tables of optimum distance profile rate 1/m 
trellis codes for small constraint lengths. Rate k/n trellis codes are constructed from a 
nesting of good rate 1/m trellis codes (m <, n). The trellis codes constructed are regular 
and the construction technique also applies to convolutional codes. The codes obtained 
are generally slightly sub-optimum, but in certain instances, the codes achieve an 
optimum distance profile and a maximum free distance. The construction technique is 
interesting both from a theoretical and a practical point of view. To the author’s 
knowledge, it is the first systematic construction technique for trellis codes which can 
be used with any rate, constraint length, and modulation scheme, and it gives some 
insight into the structure of trellis and convolutional codes. From a practical point of 
view, good distance profile codes with large constraint lengths will perform well with 
sequential decoding, where it is not so crucial to have optimum free distance codes. 
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MARC ROUANNE 
DANIEL J. COSTELLO, Jr. 

Dept, of Elec. & Comp. Engr 
Univ. of Notre Dame 
Notre Dame, IN 46556 

SUMMARY 

We present a construction technique for good trellis codes with large constraint 
length. The technique can be used with any practical constraint length, any signal con- 
stellation, and any code rate. The construction does not require an exhaustive search, 
so that the complexity of the construction does not increase significantly with the con- 
straint length. However, it requires tables of optimum distance profile rate 1/m trellis 
codes for small constraint lengths. The trellis codes constructed are regular and the 
construction technique also applies to convolutional codes. Once the code is con- 
structed we check its distance profile. We generally obtain slightly sub-optimum codes, 
but in certain instances the codes achieve an optimum distance profile and a maximum 
free distance. 

The construction technique is interesting both from a theoretical and a practical 
point of view. To the author’s knowledge, it is the first systematic construction tech- 
nique for trellis codes which can be used with any rate, constraint length, and modula- 
tion scheme, and it gives some insight into the structure of trellis and convolutional 
codes. From a practical point of view, good distance profile codes with large con- 
straint lengths will perform well with sequential decoding, where it is not so crucial to 
have optimum free distance codes. 

The construction technique nests rate 1/m trellis codes to obtain rate k/n trellis 
codes (m < n). Note that some rate 1/m trellis codes can be replaced with block codes 
to obtain most of the previously known trellis codes [l]-[3]. First, the signal constella- 
tion is partitioned into nested subsets. These nested subsets are then used as the signal 
constellation for the nested trellis codes, like subsets are used for uncoded bits in some 
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known trellis codes [1]. From tables of optimum rate 1/m trellis codes, we choose an 
optimum distance profile code for each level of the signal constellation partitioning. 
These rate 1/m codes must be good so that the upper bound on the free distance of the 
nested trellis codes achieves a large value [4]. Then, the rate 1/m subtrellises can be 
nested to form a rate k/n trellis code. Finally, the distance profile of the rate k/n trellis 
code can be computed. So far, there is no theoretical lower bound on the free distance 
of nested trellis codes, so that it cannot be guaranteed that the resulting code is good. 
However, we always obtained good codes by applying this technique or slightly 
modified versions of it [5]. 

The following table shows some rate 2/3 binary codes obtained through the 
above construction. We do not include codes of large constraint length here, although 
they can be easily constructed. Each code consists of two rate 1/2 nested trellis codes. 
The rate 1/2 codes are optimum binary convolutional codes. The table shows the 
achieved Hamming free distance, the free distance of optimum codes and of Optimum 
Distance Profile (ODP) codes, and the upper bound on the free distance of the nested 
trellis codes. For simplicity, we chose rate 1/2 sub-trellises, although rate 1/3 sub- 
trellises give a larger value of the upper bound, and generate some better nested codes. 
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1 Optimum rate 2/3 binary codes. 

2 Optimum distance profile codes. 

3 Upper bound on the free distance of the nested trellises constructed from rate 1/2 trellis codes. 
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ABSTRACT 

Hybrid Automatic-Repeat-Request (ARQ) error control coding makes use of 
both error detection and error correction in order to achieve high throughputs and low 
undetected error probabilities on two-way channels. For non-stationary channels, 
where the channel bit error rate (BER) varies over time, the technique of parity 
retransmission allows the error control strategy to adapt to the state of the channel. 

In this paper we propose a parity retransmission hybrid ARQ scheme which uses 
rate 1/2 convolutional codes and Viterbi decoding. The performance analysis is based 
on a two-state Markov model of a non-stationary channel. Throughput efficiency is 
shown to improve as the channel becomes more bursty in nature. 
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1. Introduction 

Automatic-repeat-request (ARQ) strategies have long been utilized to control 
errors on two-way digital transmission links. Most of the work in this area has been 
done using block codes with error detection only, due to the packetized nature of the 
messages and the relatively low coding overhead allowed in many systems. However, 
in systems where the packet lengths are relatively large, say on the order of 1000 bits 
or more, and where the noise and/or interference levels are high, error detection only 
results in a low throughput due to the large number of retransmissions required. Satel- 
lite networks [1] and packet radio [2] are examples of such systems. In these instances 
a combination of error correction and error detection can offer significant advantages 
over an error detection only system. This is called hybrid ARQ error control. 

Two basic types of hybrid ARQ error control strategies have been considered. 
The first type includes parity bits for both error detection and error correction in each 
transmitted packet. The decoder will correct those received packets within the error- 
correcting capability of the code, while requesting a retransmission of those packets 
with detectable but uncorrectable errors. Since bits for error correction are sent with 
every packet, the code rate places an upper limit on the throughput efficiency of the 
system. For this reason, this strategy is best suited for systems in which a fairly 
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constant level of noise and interference is anticipated on the channel. In this case, 
enough error correction overhead can be designed into the system to correct the vast 
majority of packets, thereby greatly reducing the number of retransmissions compared 
to an error detection only scheme and enhancing the system throughput. On the other 
hand, if the channel is quiet most of the time and noisy only on occasion ( a non- 
stationary channel ), designing a code to correct the occasional noisy bursts will 
reduce throughput compared to an error detection only scheme because the error 
correction overhead is wasted during the quiet periods. 

In the second type of strategy, bits for error detection only are sent on the first 
transmission. If errors are detected and a retransmission requested, parity bits on the 
original information packet are sent along with some bits for error detection. If no 
errors are detected on the second transmission, the parity bits are inverted to recover 
the original information. If errors are detected, the two received packets are treated 
together as a code word in a rate 1/2 code. If the error-correcting-capability of the 
code is exceeded, and decoding is unreliable, the original transmission is repeated. 
This process continues, alternating transmissions between the original data packet and 
the parity packet, until either an error-free packet is received or error correction is pos- 
sible. This strategy is referred to as parity retransmission [3], 

Since parity bits for error detection only are sent on the first transmission, the 
upper limit on throughput efficiency is near 1. Throughput suffers only when 
retransmissions are required, since it is only then that parity bits for error correction 
are sent. In other words, parity bits for error correction are transmitted only when they 
are needed. It is this feature which gives the parity retransmission strategy the ability 
to adapt to changing channel conditions. When the channel is quiet, parity bits for 
error detection only are transmitted, and a high throughput is maintained. Only when 
noise or interference causes packets to be received incorrectly are parity bits for error 
correction transmitted, resulting in a reduced throughput. This adaptive capability of 
the parity retransmission strategy is particularly useful in applications such as satellite 
communication and packet radio, where fluctuating channel conditions due to fading 
and interference are commonly encountered. 

Either block or convolutional codes can be used with both types of strategy. 
Schemes using the first strategy and block codes have been in existence for quite some 
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time [4-9]. Several of these schemes using convolutional codes have also appeared in 
the literature [2,10-12], Parity retransmission using block codes was introduced more 
recently [3,13,14]. Several similar schemes using convolutional codes have also been 
presented [15-18]. Although all the parity retransmission schemes that have appeared 
in the litreature have been proposed for use on non-stationary channels, the analysis in 
each case used a stationary channel model. 

In this paper, the performance of a parity retransmission hybrid ARQ scheme 
using rate 1/2 convolutional codes on a non-stationary channel is analyzed. In section 
2, a protocol is described which is capable of achieving higher throughputs than previ- 
ously proposed parity retransmission schemes. In section 3, a two-state Markov chain 
channel model is defined. This model constitutes a first approximation to a non- 
stationary channel. In sections 4 and 5, the two-state channel model is used to analyze 
the throughput and undetected error probability of the protocol presented in section 2, 
when the receiver has both an infinite and a finite buffer size. It is shown that the 
throughput improves as the channel becomes more bursty. This corresponds with our 
intuitive notion that parity retransmission schemes are best suited for non-stationary or 
bursty channels. In section 6, performance curves are calculated for a particular exam- 
ple. 

2. Description of the Protocol 

The parity retransmission hybrid ARQ scheme with a rate 1/2 convolutional code 
employs two codes, Cq and Q. C\ is a ( 2, 1, m ) convolutional code with two genera- 
tor polynomials, Gj(x) and G 2 (x), and it is used for error detection and error correc- 
tion. Cq is a high rate (n-m, n-m-r) binary block code used for error detection only, 
where r is the number of parity bits in Cq. 

When an (n-w-r)-bit information sequence I(x) is generated, it is first encoded 
into a code vector, denoted by J(x), in the (n-m, n-m-r ) block code Cq. Then the 
(n-m)-bit vector J(x) is encoded into an n-bit code vector V^(x) = J(x)G\(x), and V^x) 
is transmitted over the channel. 

A 

Let Vfo) be the noisy version of V\(x) arriving at the receiver. The syndrome of 
Vi(x) is checked in two steps. First Vj(x) is considered as a noisy version of a code 
word in the (n, n-m) shortened cyclic code generated by Gi(x). The syndrome of the 
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shortened cyclic code is checked; if it is zero, we have an estimate J(x) of J{x). Next 
the syndrome of J(x) in the high rate (n-m, n-m-r ) block code is checked; if it is 
zero, we have an estimate I(x) of I(x). The estimate I(x) is assumed to be error-free 
and is delivered to the data sink. In this case, we call Vj(x) a zero syndrome vector 
(ZSV). If, however, the first or the second syndrome check is negative, i.e., v\(x) is a 
nonzero syndrome vector (NSV), then a NACK signal is sent to the transmitter and 

A 

V^x) is stored in a receiver buffer. The transmitter then sends a second vector 
VjjC*) = J(x) ‘G 2 (x), and V 2 (x) is received after a round trip delay. Its syndrome is 
checked in two steps in the same way as Vjfx). If both syndromes are zero, V 2 (x) is 
assumed to be error-free and an estimate 7(x) of /(x) is recovered directly; otherwise, 
Vi(x) and V 2 (x) are decoded using the Viterbi algorithm, producing an estimate /(x). 

A 

The syndrome of J(x) is then checked using the ( n—m , n—m—r) block code. If it is zero, 
/(x) is recovered and delivered to the data sink; if it is nonzero, a second NACK is 
sent requesting the retransmission of Vj(x). The previously received version of Vj(x), 

A 

V^x), is discarded at the receiver and replaced by the new one. The receiver continues 
checking the syndrome of each received vector, trying to decode using the Viterbi 
algorithm if the syndrome check is negative, and requesting a retransmission of V^x) 
or Vi( x ) in alternating order if the decoding is unsuccessful, until the information vec- 
tor is delivered to the data sink. 

3. Description of the Channel Model 

Two-state model 

Let us model the channel as a Markov chain ( see Fig.l ). State 0 is the quiet 
state, where the bit error rate (BER) is e 0 . State 1 is the noisy state, where the BER is 
e i > £ o- P is the transition probability from state 0 to state 1 and p is the transition 
probability from state 1 to itself. To simplify the model’s treatment, we assume that 
one time frame in the model corresponds to the transmission of one data vector, i.e., 
the noisy bursts last for a multiple of the transmission time of a data vector. This type 
of model was first introduced by Gilbert [19J. 

It can be shown that the average burst length is 



( 1 ) 



the average BER is 
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_ (l-pOeo + P 6 ! 
e = 


( 2 ) 


I-P+P 

and the duty cycle of the noisy bursts, or the probability of being in the noisy state , is 


or 


P 1 


P 

1 ~P' + P ’ 


( 3 ) 


Pi = 


£" Ep 
e i -e o 


( 4 ) 


Four parameters govern the two-state channel model. They can be chosen to be 

» e i 

b , e , pu and the high-to-low BER ratio p — [20]. 

£o 


Burst noise model 

i 

Of the four parameters selected, one is the average channel BER and the other 
three characterize the burstiness of the channel. We shall reduce the number of 
degrees of freedom by proposing a model for the noise bursts which can be dense (low 
duty cycle p l and high intensity, i.e., large high-to-low BER ratio p ) or diffuse (large 
duty cycle and low intensity), as shown in Fig. 2. These terms were first introduced 
by Massey [21]. The conditions that we impose on a burst channel model are: 

lim e 0 = 0, (5.1) 

p. o 

lim = 1/2, (5.2) 


lim £n = £, (6.1) 

Pi -» 1 

lim Ei =£. (6.2) 

Pi -» l 


Conditions (5) represent the limiting case of a dense burst channel, i.e., p { -» 0 and 
p — > while conditions (6) represent the limiting case of a diffuse burst channel, i.e., 
Pl — » 1 and p — » 1, which is equivalent to a binary symmetric channel (BSC). 
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The two-state channel model described by (1) - (4) does not meet these condi- 
tions. In fact, from (4) we see that only condition (6.2) is satisfied. We now modify 
the two-state channel model such that conditions (5) and (6) are met 

Let 


e o = e'Pi. 


From (4) and (7), we have 

e 1 = -L-(l- Pl )F, 

Pi 


for Pl > I± 1/2 ~ ^a/2-e)(l/2 + 3e) 



otherwise. 


(7) 

( 8 . 1 ) 

( 8 . 2 ) 


From (7), we see that (5.1) and (6.1) are satisfied. From (8.1) and (8.2), we see that 
(5.2) and (6.2) are also satisfied. Now the burst channel model is completely 
described by F, p lt and b, for if these three parameters are known, p, p, e 0 , and £j can 
be determined from (1), (3), (7), and (8). Before leaving this section, we note that the 
special case P\-p=p' corresponds to the two-state block interference (BI) channel 
model proposed by McEliece and Stark [22], The BI channel model is completely 
determined by p\ and e. 


4. System Throughput and Undetected Error Probability Analysis with an Infinite 
Receiver Buffer 

In the next two sections, we analyze the throughput and the undetected error pro- 
bability of the parity retransmission hybrid ARQ scheme in the selective-repeat mode 
for both an infinite receiver buffer and a finite receiver buffer. Our analysis is based 
on the assumption that the feedback channel is error-free. In order to carry out the 
analysis, we first model the receiver’s decoding status as a Markov chain. 

Receiver’s decoding status 

Consider a Markov chain with N possible states: 1,2 , ,N, where changes in 

states can occur only at discrete times t 1( t 2 , . . . , t n ,... . Let us denote the transition 
probability from state i to state j after k time units by pfk). pfk) is called the 
k-step transition probability, and it can be determined from the one-step transition 
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probabilities, namely, p,y(l), or simply py, between all pairs of states. These transition 
probabilities can be summarized by an NxN matrix, called the one-step transition pro- 


bability matrix: 


P 1,1 P 1,2 
P2,l P'1,2 


Z=lPij\ = 


Pi# 

Pltf 


[Pn,1 Pn , 2 P/WJ 


(9) 


The probabilities in each row of P add to 1. The k-step transition probabilities can 
then be determined from the k-step transition probability matrix, which is given by 

[Pij(k)]=P k . (10) 

The states in the Markov chain can be divided into several categories. The one 
of most interest to us is the absorbing state. A state i in a Markov chain is an absorb- 
ing state if the k-step transition probability p u (k) = 1, k= 1, 2 ,... . Thus, an absorb- 
ing state is a state that cannot reach any other state in the chain except itself. A Mar- 
kov chain may contain more than one absorbing state. 

For the parity retransmission hybrid ARQ scheme described in Section 2, decod- 
ing is said to be successful if the decoded information vector is accepted by the user (it 
may be decoded correcdy or contain undetected errors). Suppose that an initial NSV 
has been received. Then the receiver’s decoding status can be modeled by the Markov 
chain shown in Fig.3. In Fig.3, states 00, 01, 10, and 11 mean that the decoder has 
received two NSVs, sent while the channel was in states 0 and 0, 0 and 1, etc., and 
that decoding has been unsuccessful. State e indicates an undetected decoding error. 
State c corresponds to error-free decoding. Once the system is in state e or state c, suc- 
cessful decoding results and retransmissions will therefore terminate. Hence, both state 
e and state c are absorbing states and we assign p e e = p c c =1. On the other hand, if , 
upon the reception of a retransmission , the decoder cannot recover the data vector, 
retransmissions will continue (the Markov chain will remain in state 00, 01, 10, or 11) 
until successful decoding occurs (the Markov chain reaches state e or state c ). 

To derive the transition probabilities of the Markov chain, we first consider the 
undetected error probability. Undetected errors occur at two levels: the syndrome 
check before convolutional decoding and. the syndrome check after convolutional 
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decoding. First we consider the former case. Let Q lt i = 0,1, be the probability of 
receiving a ZSV with an undetected error pattern while the channel is in state i. <2, 
can be upper bounded by [23] 

Qi < 2- (m+r) [l - 2(1 - e,r + (1 - 2e,) rt ] , (1 1) 

where m + r is the sum of the memory order of the convolutional code and of the 
number of parity checks in the block code (the two codes are treated at this stage as a 
single block code with m + r parity checks). 

To find the probability of undetected error after convolutional decoding, we need 
to evaluate the BER at the output of the convolutional decoder. The state ij in Fig. 3 
means that a NSV transmitted over channel state i has been held in the receiver buffer, 
another NSV sent over channel state j after one round-trip delay is received, and the 
convolutional decoding of the two NSV’s fails. The average BER in the two received 
NSV’s before convolutional decoding is then 

£( l V) = ( e i + 2, (12) 

where 


is the conditional BER given that the syndrome is nonzero, and 

P Ni = 1 - (1- £i ) n - Qi (14) 

is the probability of receiving a NSV sent while the channel was in state i. The BER 
at the output of the convolutional decoder is upper bounded by [24] 

P b QJ) * = 2 VeOV)[l - Im, 7=1, (15) 

where T(X, 7) is the generating function of the convolutional code. 

The output of the convolutional decoder is then checked by the ( n-m,n-m-r ) 
block code C 0 . We assume that the errors at the output of the convolutional decoder 
are independent. The probability of undetected error after convolutional decoding in 
state ij is then upper bounded by 


On* 2-'{i -2[i -/> i ,ov)r" + [i -2P b (ij)r^. 


(16) 
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* The probability of decoding failure is the probability of a nonzero syndrome in the 
block code C 0 , and it is given by 

Pij = 1 - [1 -P b m n - n - Qiy (17) 

By arranging the states of Fig.3 in the order: 00, 01, 10, 11, e, c , the transition 
probabilities of the Markov chain are found in Appendix A and are summarized in the 
following transition probability matrix: 

Poo.oo Poo , 01 0 0 Poo.e P 00 ,c 

0 0 Poi.io Poi.ll Poi,e Poi,c 

P 10,00 Pl0,01 0 0 PlQ,e Pl0,c 

0 0 Pll.10 Pll.ll Pll,e Pn,c 

0 0 0 0 1 0 

0 0 0 0 0 1 

where, from (A.2), (A.3), and (A.4), 
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P 00,00 = [1 ~ Poi(<*)] P NO P 00 

Poo.oi = Poi(^) Pn\ Pq\ 

Poi.io = t 1 ~ PllCd)l ^M) ^10 
Poi,n “ Pn(^) Pni Pu 
Pio.oo = t 1 ~ ftiM] Pno Poo 
Pio.oi = Poi(<0 Pm Pqi 
Pn.io - U ” Pn(^] p no P\o 
Pn,u ** PnW p m p u 

Poo,e = [1 ~ Pom [Qo + Pno Qool + Poi(^) [Qi + ^vi Qoil (19) 

Poi,e = [1 -Pim [Qo + ^A/0 QloJ + Pll(^ [Ql + Pn\ Qnl 

Pio,e = [1 - Pom [Qo + Pno Qool + Poi(^) [Qi + Pm QoJ 

Pn,e = [1 - Pii(^)l [Qo + ^vo Qio] + Pn(^ [Qi + Qnl 

Poo.c = 1 - Poo, 00 ~ Poo, 01 ~ POO,e 

P0l,c = 1 -Poi .10 -Poi.ll “Poi.e 

PlO,c = 1 ~ PlO.OO ~ PlO.Ol ” PlO.c 

Pll,c = 1 ”Pll,10 “Pll.ll — Pll,e » 

p 01 (d) and p n (d) are the d-step channel transition probabilities given by (A.l), and d is 
the number of code vectors that can be transmitted during one channel round trip delay 
period. 

Throughput efficiency calculation 

Throughput efficiency is defined as the ratio of the average number of data vec- 
tors accepted by the receiver and delivered to the user per unit time to the total 
number of vectors that can be transmitted per unit time [26]. Let E[N] be the 
expected total number of transmissions (including the initial transmission and all 
retransmissions) required for a data vector to be successfully accepted by the receiver. 
Then the throughput of selective-repeat parity retransmission hybrid ARQ is given by 
[ 26 ] 
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1 n—m—r 
E[N] ' n ’ 


( 20 ) 


In practice, men and r e n and hence ( n-m-r)/n ~ 1 . Let T be the expected 
number of retransmissions required for a data vector to be successfully decoded by the 
receiver. Then E[N] can be expressed as 

E[N] = l + T=l + j:T i P Ni p i , (21) 

1=0 


where T t i = 0,1, is the expected number of retransmissions required for a data vector 
to be successfully decoded by the receiver, given that the initial transmission was a 
NSV and was sent over channel state i, and p 0 — 1 - Pi is the probability that the 
channel starts in state 0. Thus only T,-, i = 0, 1, must be determined to find T|. 

Referring to the Markov chain shown in Fig. 3, and assuming that an initial NSV 
has been received, we see that retransmissions will be needed to recover the informa- 
tion sequence associated with the initial NSV. As soon as an undetected error or 
error-free decoding occurs (i.e., the Markov chain reaches state e or state c ), 
retransmissions will terminate, and the estimated information sequence will be 
delivered to the data sink. Therefore, the expected number of retransmissions is the 
infinite-step chain mean absorption time defined in Appendix B, and (B.9) can be 
applied to find T ( - , i = 0, 1. 

Suppose that the initial NSV was sent over channel state 0. To determine To > 
either state 00 or state 10 in Fig. 3 can be used as our initial state, since both states 
assume that a NSV sent over channel state 0 is held in the receiver buffer and waiting 
to be processed upon reception of the first retransmission. Hence, the infinite-step 
chain mean absorption time ( or equivalently, the expected number of retransmissions ) 
starting from states 00 and 10 should be the same, i.e., 


Tq - Afoo := Afio. 


( 22 . 1 ) 


Similarly, 


T x =M 0l :=M lL (22.2) 

Substituting the transition probabilities of (19) into (B.9), we obtain the following 
equations: 


^00 - 1 + Mqq poo,oo + Afoi Poo, 01 
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M 0 i = 1 + A/ 10 pouo + M u Poi.ii. 

Using (22.1) and (22.2), the above equations become 

T 0 (Poo.oo “ !) + T\ Poo.oi = -1 
To Poi,io + T\ (Poi.ii - 1) = -1 

and their solutions are 

1 + Poo, oi ~Poi.ii 


Tn = 


(1 “Poo.oo) (1 “P 01 .ll) “Poo.oi Poi.io 


(23.1) 

(23.2) 

(24.1) 


and 


r, = 


1 + Poi.io “ Poo.oo 


(24.2) 


(! “Poo.ooX 1 “Pol.ll) “Poo.oi Poi.io 

Therefore, from (21) and (24) we obtain 

rrin , ,U + Poo.oi “ Poi.nl Pm Po + [1 + Poi.io “ Poo.oo! Pni Pi 

£[N] = 1 + — • (25) 

l 1 “Poo.oo) C 1 "Poi.ii) “Poo, oi Poi.io 

The throughput for selective-repeat parity retransmission hybrid ARQ can then be 
obtained by substituting (25) into (20). 

For the special case when the channel is a BSC with BER e , (25) can be 
simplified, after some calculations, to 

1 + /y (1 - pp 


E[N] = 


1 ~P N Pf 


where 


= 1 - (1 - e) n 

is the probability of receiving a NSV and 

P/= 1 - (1 "P b r m 

is the probability of a convolutional decoding failure on two NS Vs, 

n < 1 mxn , f 

Pb - 2 07 lx=2Ve'(l - 7), Y= 1 

and 

e' = — i— . 
l-(l-e) n 


(26) 


(27) 


(28) 
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The throughput on a BSC is then 


r| = 


1 ~ Pf n—m—r 

\+P N (l-P f ) n 


(29) 


In [17], only a lower bound was obtained for a parity retransmission hybrid ARQ 
scheme on a BSC. 

Undetected error probability calculation 

The undetected error probability is the average probability of decoding error, 
given that the receiver accepts a data vector. We denote this average probability by 
P It is easy to see that 

Pud = i {& + V, P m } Pi, (30) 

t=0 

where U if i = 0,1, is the probability of undetected error in the data vector accepted by 
the receiver, given that the initial transmission was a NSV and sent over channel state 
i. 

Referring to Fig. 3, given that an initial NSV was received, undetected errors will 
occur if and only if the Markov chain enters state e. Therefore, finding U t is 
equivalent to finding the infinite-step absorption probability of the Markov chain (see 
Appendix B). Let Aqq e , A 01c , A 10>e , and A U e be the probabilities that the chain of 
Fig.3, starting at states 00, 01, 10, and 11, respectively, will eventually be absorbed by 
state e. By an argument similar to the throughput calculation, we can show that 

= A W,e~ A \0,e (31-1) 

= ^01, e = A Ue (31.2) 

Substituting the transition probabilities of (19) into (B.8), it follows that 

^oo,* = A QQ e Poo, oo + A 01e p 00 01 + Poo,* 

^oi, * = ^io,* Poi,io + ^ii,* Poi.ii + Pom. 

From (31), the above equations reduce to 

U Q (1 ~ Poo.oo) ” Ui P 00,01 = Poo,* 


_ ^oPoi,io + ^i(! -Poi.il) “Pom. 


(32.1) 

(32.2) 
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Solving (32) we obtain 


u 0 = 


P(X),e(l~P01,l l) + P01,fP00,01 
( i-Pou O-Poo.oiPoi.io 


(33.1) 


U i = 


P 01 .g( 1 ~P 0 O, 0 o) + P 0 Q,eP 01 ,lO 
( 1_ Poo,oo)( 1- Poi ,i i)“Poo,oiPoi.io 


(33.2) 


Thus, from (30) and (33), the probability of undetected error for selective-repeat parity 
retransmission hybrid ARQ with an infinite receiver buffer is given by 


P ud ~ 


\Qq + 


\Q& 


P0Q,g(l~P0Ul) + P01,eP00,01 
( 1- Poo,oo)( 1_ Poi,i i)~Poo,oiPoi,io 

P01,e( ^POO.OoHPOO.ePOl.lO 


no 


Po 


(l - Poo,oo)( 1 _ Poi,i i)~Poo,oiPoi,io 


m 


Pi- 


(34) 


If the channel is a BSC with BER e, (34) can be simplified to 

Q+P N P e 

p ud = Q + ~ p / -> (35) 

1 ” P N P f 

where P N and Pf are given by (27) and (28), respectively, 

Q < 2~< m+r) [l - 2 (1 - e) n + (1 - 2 e) n ] (36) 

is the probability of receiving a ZSV with an undetected error pattern, and 

p e <L2~ r [\- 2{\-p b r m + (l-2p b r m ] (37) 

is the probability of undetected error after convolutional decoding of two NSVs. 


5. System Throughput and Undetected Error Probability with a Finite Receiver 
Buffer 

In this section we analyze the throughput and the probability of undetected error 
for the selective-repeat parity retransmission hybrid ARQ with a finite receiver buffer. 
Let B be the number of code vectors that the receiver buffer can store. The perfor- 
mance is analyzed for the case when 


B = Id, l ==1,2,3,.... 


(38) 
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The system with receiver buffer size B operates as follows. Normally, the 
transmitter sends code vectors continuously to the receiver. The receiver checks the 
syndrome of each received code vector. If the syndrome is zero, the received vector is 
assumed to be error-free and is delivered to the user, and an ACK signal is sent to the 
transmitter. When the channel is quiet, data transmission proceeds smoothly; error-free 
vectors are delivered to the user in consecutive order and the receiver buffer is empty. 
The receiver is said to be in the normal phase if the receiver buffer is empty. 

When a received code vector is detected in error (NSV) while the receiver is in 
the normal phase, the receiver enters the blocked phase and sends a NACK to the 
transmitter. The NSV is then stored in the receiver buffer for error correction at a later 
time. In the blocked phase, the receiver continues to check the syndrome of each 
incoming received code vector, sends an ACK to the transmitter for each received 
ZSV, and sends a NACK to the transmitter for each received NSV. The received vec- 
tors, no matter whether they are ZSVs or NSVs, are stored in the receiver buffer until 
they are ready to be released to the data sink. In the blocked phase, no vector is 
delivered to the data sink until the earliest received NSV is accepted by the data sink. 

If the earliest NSV is recovered within / retransmissions, the receiver then starts 
to deliver this vector and the subsequent ZSVs ( which are held in the receiver buffer ) 
to the data sink in order until the next NSV is encountered. This vector then becomes 
the earliest NSV. If all the vectors held in the receiver buffer are released to the data 
sink after the earliest NSV has been recovered, the receiver buffer becomes empty 
again and the receiver returns to the normal phase. 

If the receiver fails to recover the earliest NSV after / retransmissions, no further 
retransmissions are allowed. The receiver simply delivers the erroneous decoded vector 
to the data sink and sends an ACK to the transmitter. Because the receiver has a buffer 
size B = hd, buffer overflow will never occur, and the system operates in the same 
way as though the receiver had an infinite buffer size, except for the forced vector 
delivery upon receiving the Itjh retransmission. The tradeoff in system performance by 
limiting the number of retransmissions to / will be an increased throughput and a 
decreased system reliability compared with systems without this limitation. 
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Throughput efficiency calculation 

Let E[N([)] be the expected number of transmissions needed to deliver a code 
vector to the user within / +1 transmissions ( including the initial transmission and up 
to / retransmissions ). The throughput of the selective-repeat parity retransmission 
hybrid ARQ with receiver buffer size B = id is then 


1 n-m-r 
E[N([)] ‘ n ■ 


(39) 


By a similar argument as in the infinite receiver buffer case, we obtain 


E[N(i ) ] - 1 + Tq(P) P no p 0 + T{(i) P p\ , (40) 

where T,(/), i = 0, 1, is the expected number of retransmissions required for a data vec- 
tor to be successfully decoded within / retransmissions, given that the initial vector 
was a NSV and sent over channel state i. 


We readily recognize that finding T,(/) is equivalent to finding the Markov chain 
mean absorption time within / transitions ( see Appendix B ), so that (B.4) and (B.6) 
can be used. Note that the computation can be reduced by combining state e and state 
c in Fig.3 into a single state, called state s, since both states e and c are absorbing 
states. Thus state s is simply the state corresponding successful decoding. The new 
transition probability matrix, obtained by merging states e and c into state s, is given 
by (see (18)) 


P' = 


Poo.oo Poo , 01 0 o P00,s 

0 0 Poi.io Pout Pou 

PlO.OO PlO.Ol 0 o Pl0,s > 

0 0 Pll.10 Pll.ll Pu,s 

0 0 0 0 1 


(41.1) 


where 


Pij,s ~ Pij,e Pij,c (41 -2) 

Let Mqo( 0 and be the mean absorption time within / transitions of the Mar- 

kov chain described by (41), conditioned on the chain starting in state 00 and state 01, 
respectively. From (B.4) we have 

i 

UD - Mqq([) = Poo s + Oo0,s(«) - P00,s( rt “l) ] > 

n=2 


(42.1) 
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Ti ( 0 = M 01 (/) = p Qhs + [po u (n) - 3» 

n=2 


(42.2) 


where /?oo^( n ) and PqiJji) are the n-step transition probabilities from state 00 and state 
01, respectively, to state s, and they can be determined from (41), (19), and (10). The 
system throughput of selective-repeat parity retransmission hybrid ARQ with receiver 
buffer size B = id, from (39), (40), and (42), is given by 

* = T7 r r • (43) 


(n-m-r)/n 

1 

f i 1 


i + 2> 

\P0i,s+ Z n [>0i>(«) — Po*>("— !)] 

* f*Ni Pi 

t=0 

L J 



Undetected error probability calculation 


The probability of undetected error for selective-repeat parity retransmission 
hybrid ARQ with an infinite receiver buffer is given in (30). The probability of 
undetected error for the system with receiver buffer size B = id can be derived from 
(30) with a slight modification. It is given by 

if 1 


Pud-'L' 


Qi + mn + Em p m 


pi. 


(44) 


t=0 ^ 


where £/,(/) is the probability of undetected error within / retransmissions, given that 
the initial transmission was a NSV and sent over channel state i. £,(/) is the probability 
of unsuccessful decoding on the Ith retransmission, given that the initial transmission 
was a NSV and sent over channel state Since only up to / retransmissions are per- 
mitted in the system, if the Ith retransmission results in a decoding failure, the errone- 
ously decoded data vector will be delivered to the data sink. Hence, it is reasonable to 
regard this decoding failure as an undetected error, and its probability , £,(/), should be 
included in (44). 


Let A 00 e (/) and A 01e (/) be the probabilities that the Markov chain, starting at 
states 00 and 01, respectively, will be absorbed by state e within / transitions. Clearly, 
U 0 (l) = A 00g (/) and Ui(l) = A 0l e (l). It follows from (B.2) that 


Uq(1) - Aqq JJ.) - Poo,e(0 (45.1) 

and 


U i(/) = A 0l /l) = p 0l>e (l). 


(45.2) 
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where Poi,e(0» < = 0, 1, is the /-step transition probability from state 0 i to state e. We 
also have 


Ei([) = Pr 


■jThe chain reaches 00, 01, 10, or 11 after / steps | The chain starts in 


- Poi,oo(0 + Po;,oi(0 + Po/,io(0 + Po/,n(0- 


(46) 


Combining (45) and (46), we obtain 


U it) + Ei(l) = 1 - Poi >c (0» 


(47) 


which is the probability that the chain starting in state 0* , i = 0, 1, will not reach state 
c within / transitions. In other words, (/,(/) + £,(/) is simply the probability that the ini- 
tial NSV will not be decoded correctly within / retransmissions. Thus, the probability 
of undetected error for selective-repeat parity retransmission hybrid ARQ with receiver 
buffer size B = id, from (44) and (47), is given by 


p u4=k 

i=0 


2 ; + [1 -Poi,M Pm\ Pi- 


rn 


6. Examples 

In this section, we plot the performance of selective-repeat parity retransmission 
hybrid ARQ for the following parameters: 

Cq : (1024, 1000) binary code 

Ci : (2, 1,6) ^ = 10 convolutional code 

Channel round trip delay : d = 128. 

Four curves, numbered 0 through 3, appear in each plot. They correspond to four 
values of the burst duty cycle, which was defined in section 3 as the parameter which 
determines the burstiness of the channel: 

Curve 0 : Pi = 1 ( Stationary channel ) 

Curve 1 : Pi = 0.25 ( Diffuse burst channel ) 

Curve 2 : Pi = 0.1 
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Curve 3 :p\= 0.05 ( Dense burst channel ) . 

In the performance calculation, we found that, for a given pi and e, different 
values of b have a very small influence on the throughput and undetected error proba- 
bility. Therefore, we considered only the case when p =p' = P\, i.e., a BI channel. 
Figs. 4 and 5 show the throughput and the probability of undetected error for 
selective-repeat parity retransmission hybrid ARQ with infinite receiver buffer. Fig. 6 
shows the probalility of undetected error with receiver buffer size B = 5d. The system 
throughput is essentially the same as in the infinite receiver buffer case. 

From Fig. 4 we observe that the system throughput is much better for a given 
average BER if the errors occur in bursts, since the errors are then concentrated in 
fewer vectors and the convolutional code is still powerful enough to decode them. 
From Fig. 5 we see that the burstiness of the channel has a limited influence on the 
undetected error probalility, except in the range of average BERs 4X10 -4 <F< 10 -2 . 
In this range, and for a bursty channel, most of the errors are concentrated in the vec- 
tors received while the channel is noisy. The convolutional code is powerful enough 
to decode most of these noisy vectors reliably. On the other hand, if the channel is sta- 
tionary, the vectors which are received during the quiet state contain more errors, and 
there are more undetected errors than in the non-stationary case, because of the limited 
power of the block decoder. 

Fig. 6 shows the degradation in system reliability when the receiver buffer size is 
limited to five times the channel round trip delay ( B = id. = 5d ). The degradation 
becomes obvious for average BERs in the range e> 4xl0 -3 . For small / and high e, 
although most errors can be corrected within / retransmissions, a small percentage of 
error vectors cannot be corrected, and those error vectors will have a serious effect on 
the probability of undetected error. Obviously, as / becomes large, the system becomes 
more and more reliable. 

7. Discussion and Conclusions 

Wang and Lin proposed a hybrid ARQ scheme with parity retransmission using 
two block codes C 0 and Cj [17]. C 0 is an (n,k) high-rate error-detecting code and 
is a half-rate (2 n,n) code which is designed for error correction only. However, C { 
must be invertible and an inverse operation is required at the decoder to recover the 
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information data vector from the retransmitted parity check vector. In [17], the perfor- 
mance of hybrid ARQ schemes using both a rate 1/2 invertible block code and a rate 
1/2 convolutional code were analyzed for a BSC. The results indicate that convolu- 
tional codes provide a higher throughput than block codes, especially on very noisy 
channels (BERs around 10 -2 ). However, since these results were obtained for a BSC, 
and since parity retransmission hybrid ARQ schemes are designed for use on non- 
stationary channels, a more detailed analysis was needed. In this paper, we have 
presented a thorough analysis of a parity retransmission hybrid ARQ scheme using 
convolutional codes for a non- stationary channel, assuming both infinite and finite 
receiver buffers. Results show that high throughput efficiencies and low undetected 
error probabilities can be maintained over a wide range of channel parameters and that 
the throughput efficiency improves as the channel becomes burstier in nature. In addi- 
tion, the undetected error probability performance is better for burstier channels. These 
results substantiate the claim that parity retransmission hybrid ARQ schemes using 
convolutional codes are particularly well suited for use on non-stationary channels. 

Unlike block codes, "invertibility" is not required for convolutional codes in a 
hybrid ARQ scheme with parity retransmission. Therefore, convolutional codes with a 
variety of code rates can be incorporated into hybrid ARQ schemes. Hybrid ARQ 
schemes using rate 2/3 and 3/4 convolutional codes have been proposed and analyzed 
over non-stationary channels in [20]. The rate 2/3 and 3/4 schemes provide much 
better throughput than the rate 1/2 schemes at the cost of a more complex Viterbi 
decoder, a larger buffer, and a more complex buffer strategy. For instance, assuming 
the duty cycle of the noisy burst is p l = 0.05, the average channel BER is IT = 10~ 2 , 
and the memory order of the convolutional code is 3, the throughput is equal to 0.6 for 
the rate 1/2 scheme, 0.74 for the rate 2/3 scheme, and 0.8 for the rate 3/4 scheme [20]. 
These higher rate hybrid ARQ schemes are very attractive for use on high speed non- 
stationary channels, such as satellite communication channels. 
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Appendix A 

In this appendix we derive the transition probabilities of the Markov chain shown 
in Fig.3. 


Transition probability from state kj to state ji, 

Let d be the number of code vectors that can be transmitted during one channel 
round trip delay period. Since the retransmitted vector is received after one channel 
round trip delay , in the following calculations we need to know the channel d-step 
transition probabilities. The channel d-step transition probabilities Po\(d) and Pu(d) of 
being in state 1 d time frames after being in state 0 and state 1, respectively, are given 
by [25] 


and 


Po\(d) = 


1 +P~P' 1 + P~P 


7 (P'~ P) d > 


(A.1.1) 


PlM = T+n n' + U n P \’ & ~ 
1+p-p l +P ~P 


(A. 1.2) 


Let us consider the transition from state 01 to state 10. State 01 means that two 

A A 

NSVs Vfa ) and V 2 (x) , sent over channel states 0 and 1, respectively, have been 
received and that decoding has failed. V\(x) is then discarded and V 2 (x) is held in the 
receiver buffer. The transition from state 01 to state 10 means that a new NSV V 3 (x), 
sent over channel state 0 after a round trip delay, has been received with probability 
[ 1 — Pn(d) ] PtfQ, and that convolutional decoding of the two NSVs, V 2 (x) and V3OC), 
has failed with probability P 10 . The transition probability from state 01 to state 10 is 
therefore given by 


Poi.io - [1 ~ Pii(^)] P no P 10. 

By a similar argument we obtain 

Poo , 00 = [1 -PoiWl P NQ P 00 
Poo, 01 = Po\(4) Pn\ P 01 
Poi.io = [1 - Pn(d)] P N0 P l0 
Poi.ii = Pn(^) P m P 11 



Pio.oo - [1 ~ Pom Pm Poo 
Pio.oi =Poi(<t) Pni Pqi 
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(A.2) 

Pi 1,10 = t 1 ~ Pii(^l P no Pio 

Pli.ll = Pii(<=0 Pjvi ^li- 

Transition probability from state ij to state e, pij e 

Consider the transition from state 01 to state e. In state 01, the decoding of the 
two NS Vs V^Ot) and V 2 (x) sent over channel states 0 and 1, respectively, has failed. 
V^x) has been discarded and replaced by a retransmitted vector V 3 (x), which was 
received one round trip delay after the reception of V 2 (x). The transition from state 01 

A 

to state e means an undetected error is made in the syndrome check of V 3 (x) , or if 
V 3 (x) is a NSV, in the decoding of V 2 (x) and V 3 (x). Note that V 3 (x) may be sent over 
channel state 0 or 1. Consider the case when the channel is in state 0. The probability 
of such an event is the d-step transition probability in the channel model from state 1 
to state 0, [ 1 - pu(d) ]. An undetected error is made when performing the syndrome 
check on V 3 (x) with probability Qq. If the syndrome check on V 3 (x) is nonzero (with 
probability P^q), another undetected error can be made in the convolutional decoding 

A A 

of V 2 (x) and V 3 (x) with probability Q 10 . The undetected error probability, given that 
V 3 (x) is received while the channel is in state 0, is therefore 

Pq = Qo + Pno Gio- 

A 

Similarly, the probability of making an undetected error, given that V 3 (x) is received 
when the channel is in state 1, is 

E \ ~ Q\ + p m Qn- 

The transition probability from state 01 to state e is then obtained by averaging £ 0 and 
E \ : 

Pou = t 1 - P\m E o + Pi i(<0 E i • 

The transition probabilities from the three other states to state e are obtained similarly, 
and we have 

Poo,e = [1 “ Pom ( Qo + e no Qoq) + Poi(d) (Qi + Pni QoO 
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Po\,e - ~Pn(^)] (Co + ^Wo Cio) + Pn(*0 (Ci + ^Vi Cn) 

Pio.« = [l - PoiC^)] (Co + Coo) + Poi(^) (Ci + ^Vi Coi) (A.3) 

Pu,e = ~Pll(^)] (Co + I*N0 Cio) + Pll(^) (Cl + Cll)- 

Transition probability from state ij to state c, 

Realizing that the transitions from state ij to states jk, e, and c are mutually 
exclusive and collectively exhaustive, the sum of the corresponding transition probabil- 
ities must add up to 1. Therefore 

P00,c = 1 ~ POO , 00 “ POO, 01 " P00,e 
P0l,c = 1 “Poi.io "Poi.ll ~Poi,e 

PlO,c - 1 ~ PlO.OO ~ PlO.Ol - PlO.e (A.4) 

Pll.c = 1 “Pll.10 “Pll.ll - Pll,e- 
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Appendix B 

In this appendix we present some results concerning Markov chains which are 
used throughout the paper. 

First passage probability 

The n-step first passage probability, denoted by fj ib (n), is defined as the probabil- 
ity that a Markov chain starting from state j will be in state b for the first time after n 
transitions. If b is an absorbing state, these probabilities can be found directly from the 
n-step transition probabilities as follows: 

fj,b(V = Pj,b( l ) = Pj,b 

fjAZ) = Pj,bO - Pj,b( 1) 

fj,bO)=Pj,bQ)-Pj,bO-) (B.l) 


fj,b( n ) = Pj,b( n ) ~ Pj,b( n ~l)- 

To prove (B.l), we observe that the one-step first passage probability is the same 
as the one-step transition probability. For n = 2, the two-step transition probability 
Pj t b( 2) contains the probability of visiting state b immediately after the first transition 
and remaining in state b during the second transition. Hence, the probability of this 
event, pj b (l)-p bb (l), should be subtracted from pj b ( 2) to obtain the two-step first pas- 
sage probability, i.e., j^(2) = pj b (2) ~ Pj ib (l)'P b>b (l). Since b is an absorbing state 
(i.e., p b>b {\) = 1), we have/^(2) = pj b ( 2) ~Pj tb ( 1). The rest of (B.l) is based on simi- 
lar reasoning. 

Once the first passage probabilities have been determined, the following important 
quantities can be evaluated. 
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Absorption probability and mean absorption time 

The l- step absorption probability, denoted by Aj b (l), is the probability that a Mar- 
kov chain initially in state j will be absorbed by absorbing state b within l transitions. 
It follows from (B.l) that 

/>,»(") =P;j,(0- (B.2) 

re=l 

The infinite-step absorption probability, denoted by Aj b , is the probability that a chain 
starting in state j will eventually be absorbed by absorbing state b. Thus from (B.2), 

A j,b ~ A j,bi°°) = (B.3) 

Note that if the Markov chain contains only one absorbing state, Aj b = 1, since the 
chain will eventually reach b and be trapped there. 

We denote the l-step mean absorption time by Mj b (l). It is defined as the mean 
time that a Markov chain starting in state j will be absorbed by absorbing state b 
within l transitions. From (B.l) we obtain 

Mjjbi 0 = 2 n fj,b( n ) = Pj,b + >> lPj,b( n ) ~ Pj,b ( n ~ !)]• (B.4) 

n= 1 n=-2 

The infinite-step mean absorption time, denoted Mj b , is then 

M j,b = = Pjjb + [ Pj,b( n ) ~ Pj,b ( n ~ !)]• (B.5) 

n=2 

Mj b is the mean period of time after the chain leaves state j until it is eventually 
absorbed by state b. 

Let S be the set of absorbing states in a Markov chain. Define the l-step chain 
mean absorption time as 

Mj(l) = X M j>b (l), (B.6) 

beS 

and the infinite-step chain mean absorption time as 

Mj = £ Mj M . (B.7) 

b eS 

Obviously, Mfl) is the mean time of absorption within /-transitions if the chain starts 
from a given initial state j, and is the mean time required for a Markov chain to be 
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eventually absorbed if it starts in state j. 

Easy ways of finding Ay b and My 

Because the calculations of A J* and Mj involve the infinite-step transition proba- 
bility, direct evaluation of Aj b and Mj from (B.3) and (B.7) become impracti- 

cal. However, they can be determined in alternative ways. Let N be the number of 
states in the chain. The Aj b 's are related by the following set of equations [27]: 

N 

A i,b ~ X \b pj,i for al1 J e S. (B.8) 

i= l 

Note that, when the initial state is b, it is already absorbed in b, and hence A bb = 1, 
whereas when the initial state is some other absorbing state, say a , then it will never 
be absorbed by b, and hence A a b = 0. For all other initial states, a set of simultaneous 
equations may be written from (B.8) whose solution is Aj b . 

The infinite-step chain mean absorption times. My, can be determined by solving 
the following set of equations [27]: 

N 

My = 1 + X Mj pj i for all j e S. (B.9) 

t=l 

Observe that if state i is an absorbing state, the chain is already in an absorbing state, 
and Mj = 0. 
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Fig. 5 Probability of undetected error of rate 1/2 selective- 
repeat ARQ with infinite receiver buffer. 










